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Command  and  control  limitations  are  Incorporated  into  the  model  through  up- 
per and  lover  bounds  on  the  rate  at  which  the  distribution  of  fire  can  be 
changed.  The  structure  of  the  optimal  fire  distribution  policy  is  examined.  ■ 
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It  is  shown  that  such  command  and  control  limitation*  do  not  essentially 
alter  the  optimal  fire  distribution  decision  rules,  although  th*  shifting  of 
fires  is  initiated  earlier  when  command  and  control  limitations  exist  than 
vhen  an  entire  force  can  instantaneously  shift  their  flrss  from  one  target 
type  to  another.  Thus,  when  there  is^inertiaMfo  overcome  in  shifting  ,'ires^ 
one  begins  to  change  the  distribution  of  fire  before  target  priorities  change 
in  anticipation  of  this  coming  change.  The  theory  of  state  variable  in- 
equality constraints  plays  a major  role  in  solving  this  problem.  Of  particu- 
lar mathematical  difficulty  is  the  presence  of  a second  order  state  variable 
inequality  constraint  in  the  problem 
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1 . Introduction. 


In  all  the  fire  distribution  problems  that  we  have  considered 
previously  [14]-[19]  an  implicit  assumption  has  always  been  that  fire  could 
be  instantaneously  shifted  from  one  target  type  to  another.  To  illustrate, 
let  us  recall  a typical  problem: 


maximize  (ry(T)  - px.  (T)  - qx.(T)}, 
♦<t)  1 2 

dx 

subject  to:  - - ^y, 

dx2 

dt  " -<W)«2y. 


P-  • - b,x,  - b«x_, 
at  11  2 2 


a) 


xl’x2’y  4 ° and  0 < 4 £ 1, 

and  with  initial  conditions 

x^t-0)  - x°,  x2(t-0)  - x°,  y(fO)  • yQ. 

In  this  problem  4 (the  fraction  of  the  Y-forces  which  fires  at  X^> 
is  the  control  (decision  or  policy)  variable.  The  reader  should  note  that 
although  the  control  must  satisfy  the  condition  0 i ^ < 1,  the  rate  of 
change  of  4 is  unrestricted  so  that  4 can  instantaneously  change,  for 
example,  from  0 to  1.  Physically,  this  means  that  we  are  assuming 
that  Che  T-forces  can  Instantaneously  shift  fires  as  desired. 

When  one  considers  command  and  control  problems  in  combat,  the 
above  implicit  assumption  on  4 (instantaneous  jumps  permitted)  does  not 
seem  to  be  a realistic  one.  A better  asstasption  appears  to  be  that 
there  is  a limit  to  how  fast  4 can  be  changed.  For  example,  consider  a 
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homogeneous  Y-force  in  combat  against  hetarogeneous  enemy  forces.  A 
command  and  control  system  directs  the  fire  of  the  homogeneous  Y-force 
against  particular  enemy  targets.  The  effectiveness  of  the  command  and 
control  system  might  be  measured  in  terms  of  the  speed  and  accuracy  with 
which  units  of  the  Y-force  react  to  orders  as  to  which  type  of  enemy  unit 
at  which  to  fire  (see  [13]  for  some  similar  ideas).  This  fire  distribution 
process  may  be  described  in  terms  of  a distribution  of  fire  variable  <fr. 

We  have  thus  been  led  to  consider  target  selection  problems  in  which  the 
rate  of  change  of  the  allocation  variable  is  bounded  (i.e.  instantaneous 
shifts  in  fire  are  not  allowed) . For  reasons  discussed  below,  we  have 
chosen  to  call  such  a situation  "inertial  combat." 

Although  problems  in  which  curves  are  restricted  to  lie  in  a given 
domain  were  considered  in  the  classical  calculus  of  variations  as  long  ago 
as  1831  [3]  (see  also  [1])  and  discussed  by  Weierstrass  in  his  lectures  of 
1879  (see  p.  395  of  [1]),  development  of  optimality  conditions  for  optimal 
control  problems  with  state  variable  inequality  constraints  has  been 
accomplished  only  comparatively  recently.  Aa  the  author  pointed  out  in 
[19] , state  variable  inequality  constraints  (SVIC's)  are  present  in  all 
Lanchester-type  optimal  control/differential  game  problems.  Recent  activity 
in  developing  necessary  conditions  of  optimality  for  problems  with  SVIC's 
apparently  owes  its  origin  to  tha  work  of  Gaakrelldze  (for  an  English 
translation  of  hia  original  work  see  Chapter  VI  of  [11]).  Gamkrelidte 
points  out  that  in  many  physical  problems  there  are  restrictions  not  only 
on  tha  control  parameters  but  also  on  the  state  (phase)  apace.  He  (see 
p.  263  of  [11])  refers  to  piecewise  continuous  controls  as  "inertialess 
controls,"  since  such  controls  can,  if  need  by,  instantaneously  jump  from 
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one  value  Co  another.  Following  Gamkrelidze  Chen,  we  use  Che  term  Inertial 
combac  to  refer  to  a target  selection  problem  In  which  the  rate  of  change 
of  the  distribution  of  fire  Is  bounded. 

In  [17]  the  author  first  applied  the  theory  of  SVIC's  (the  approach 
of  Gamkrelidze  [11])  to  an  allocation  problem  In  the  Lanchester  theory  of 
combat.  In  this  first  application  little  more  than  developing  optimality 
conditions  on  constrained  subarcs  was  done.  In  [19]  we  Introduced  a more 
convenient  approach  to  first  order  SVIC's  (the  approach  of  Speyer  (see  [6])) 
and  used  theory  (including  corner  conditions  and  boundary  conditions  for 
the  adjoint  variables  (see  also  [21]))  to  completely  solve  a problem 
similar  to  (1).  The  paper  at  hand  further  extends  such  results:  we  con- 
sider a problem  with  a second  order  SVIC  (as  well  as  first  order  SVIC's). 
This  application  is  possible  because  of  theoretical  results  recently  obtained 
by  the  author  who  extended  Gamkrelidze 's  multiplier  condition  [11]  (see  also 
[20])  to  a order  SVIC  [22]  (see  also  [21]).  The  reader  can  find  a 

further  discussion  of  the  theory  of  SVIC's  in  [17]  and  [19]  (see  also  [6] 
and  [10]). 

This  paper  is  organized  in  the  following  fashion.  First,  we  discuss 
the  optimal  control  problem  (optimal  fire  distribution  in  the  presence  of 
command  and  control  limitations).  Then,  the  basic  necessary  conditions 
of  optimality  are  developed  for  the  problem.  Next,  the  synthesis  of  the 
extremal  fire  distribution  policy  is  outlined  in  several  cases.  The 
determination  of  the  optimal  fire  distribution  policy  is  discussed,  and 

f 

This  terminology  was  apparently  first  coined  by  Bryson,  Denham,  and  Dreyfus 
[3].  They  say  that  a problem  has  a ordar  SVIC  whan  the  time 

(total)  derivative  of  the  state-variable  constraint  is  the  first  derivative 
to  explicitly  contain  the  control  variables. 
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a more  general  model  considered.  Finally,  we  discuss  Che  Insights  gained 
Into  the  optimization  of  combat  dynamics  from  our  study  of  the  problem  at 
hand. 


2 . The  Fire  Distribution  Problem  In  the  Presence  of  Command  and  Control 
Limitations . 

Accordingly,  we  consider  the  following  problem: 

maximize  {ry(T)  - px. (T)  - qx.(T)}  with  T,  specified, 
u(t)  1 2 1 


subject  to: 


*i ,x2,y  a °»  T * tx, 

and  with  initial  conditions 


dx 

X 

■ — — m 

dt 

dx- 

i 

dt 

-(l-*)a2y 

iz.  - 

— b X — 1 

dt 

11 

ii  . 

dt 

u» 

0 at  $ a 1 , and  - a u < Ry , 


(2) 


- x°,  x2(t-0)  - x°,  y(t-O)  - yQ,  <Kt-0)  - *Q, 

where  all  symbols  are  defined  in  the  next  section  and  R^.Ry  >0.  It 
should  be  noted  in  the  above  model  it  is  no  longer  possible  for  + to 
instantaneously  change  from,  for  example,  0 to  1 as  it  had  been  for 
(1) . As  we  discussed  in  the  introduction,  this  is  how  we  incorporate 
command  and  control  limitations  into  our  model. 

We  will  focus  primarily  upon  the  development  of  the  basic  necessary 
conditions  of  optimality  for  (2)  and  the  synthesis  of  extremal  control  from 


> 


. 
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these.  As  discussed  more  thoroughly  in  Section  8,  It  is  not  practical 
for  computational  reasons  to  completely  carry  out  the  determination  of 
the  optimal  control.  Thus,  for  this  more  limited  goal  of  characterizing 
the  optimal  fire  distribution  policy  the  nature  of  the  planning  horizon 

(terminal  target  set  or  prescribed  duration)  doesn't  make  any  difference, 

* 

and  we  will  be  purposely  vague  on  this  point. 

The  reader  should  note  that  the  control  variable  in  problem  (2)  is 
u,  while  $ (the  control  variable  in  problem  (1))  is  now  a state  variable. 
Hence,  the  restriction  0 £ $ £ 1 is  now  equivalent  to  two  (first  order) 
SVIC's.  When  we  use  the  approach  of  Gamkrelidze  (see  Chapter  VI  of  [11]) 

(as  modified  by  Bryson  et  al.  [3]  (see  also  [6])),  a SVIC  such  as 
C(t,x^(t))  £ 0 is  replaced  by  the  point  constraint 


Cltentry**i)  " °* 

and  the  control  inequality  constraint  on  the  state  boundary  (C»0) 

(t’xi’u)  * 0 for  ‘ € 1 ‘entry ’‘exit1* 

Thus,  for  $ - 1 £ 0,  we  treat  boundary  arcs  when  $ * 1 by  considering 
♦(t<ntry)  - 1 and  then  requiring 

£ " u £ 0 for  t € when  * - 1 - 0,  (3) 

and  for  -#  £ 0,  we  treat  boundary  arcs  when  * - 0 by  considering 


♦(tentry)  “ 0 and  then  requiring 


i! 

dt 


u £ 0 for  t 6 when  " ♦ " <A> 


However,  see  [14] -[18]  for  the  type  of  considerations  (l.e.  enumeration 
of  all  possible  terminal  states)  required  for  developing  a complete  solution 
to  such  a problem. 
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To  avoid  being  encumbered  by  too  many  symbols,  we  will  consider 
only  one  of  the  two  SVIC's  x^,x2  * 0*  Clearly,  we  lose  no  generality  in 
considering  x^  s 0.  In  this  case,  we  have 

C(t,xt)  - - xx  * 0,  (5) 

dT  (t’Xi>  " - dT  " ♦V*  (6) 

d^c 

jjHT  (t,x1,u)  - ua^y  - I^a1(b1x1+b2x2) . (7) 

On  a constrainted  subarc  on  which  x, (t)  ■ 0 for  t _ attst  . ^ , 

1 entry  exit 

the  SVIC  is  replaced  by  the  point  constraints 


C(t  . ,x, ) ■ - x,  (t  ) ■ 0, 

entry’  i'  lv  entry 


dC 

&£  <t«ntry'xi)  * ' dT  ‘‘entry*  “ *(tentry)aly  " °* 


and  the  control  inequality  constraint 


dF  (t’Xi’u)  * UV  " ♦*1<Vl+b2X2)  S ° f°r  ‘ € [tentry,texit]  * (10) 

Thus,  x^  i 0 is  a second  order  SVIC.  Clearly,  when  x^(t)  * 0 for  a 
finite  interval  of  time,  by  (6)  we  must  have  $*(t)  • 0 (since  y > 0) 
and  then  (7)  yields  u*(t)  - 0,  where  we  have  considered  the  state 
equations  (2) . 


3.  Notation. 

The  symbols  which  are  used  in  this  paper  are  defined  as  follows: 


a^,a2,b1,b2  ■ constant  attrition-rate  coefficients, 


<*>«.>  -ft  I 
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F($,u)  ■ rate  of  change  of  fraction  of  Y-fire  directed  at  in  more 

general  redistribution  of  fire  model. 


H ■ Hamiltonian  function, 

J ■ criterion  (return)  functional  • ry(T)  - px^(T)  - qx2(T), 

p,q,r  - utilities  assigned  to  surviving  X^,  X2  and  Y forces 
respectively, 


p.(t)  for  i - 1,2, 3, 4 - dual  variable  corresponding  to  x (t) 

U3(t)  - y(t),  x^(t)  - ♦ ( t) ) , 


lower  and  upper  bounds  on  magnitude  of  rate  of  change  of 
(i.e.  s u s Ry) , 


t ■ time  after  beginning  of  battle, 

i 

' tg  “ time  of  entry  to  constrained  subarc, 

! t-  " lim  t, 
e t*t 

e 

tit 

e 

| t « time  of  entry  to  constrained  subarc  with  $(t)  ”0  for  t £ t £ t^ 
| 6 (similarly  for  t* ) , 

i t^  - time  of  leaving  constrained  subarc, 

I 

t ■ time  at  which  u*(t)  switches  from  to  -JL  with  0 < $ < 1 ; 

8 defined  by  p. (t»t  ) ■ 0, 

4 s 

t^  ■ time  at  which  X^  is  annihilated,  i.e.  x^(t^)  ■ 0* 

I 

It  - time  at  which  battle  ends, 

“ maximum  possible  duration  for  battle,  i.e.  T £ T^, 

l 

4 ■ control  variable  for  redistribution  of  fire, 

I 

vi-  v(t)  - a1(-p1(t))  - a2(-p2(t)), 

\ 

\ 

\ 

\ 

\ 

\ 

I 

\ 

\ 
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W - Bellman's  optimal  value  function, 

i 

X1,X2’^  " com^atant  force  levels;  with  initial  values  x°,x2>yg, 

6,61,62  “ positive  constants, 

n,(t) Cn2 C t) ) » multiplier  corresponding  to  state  variable  inequality 
constraint  $ £ 1 ($i0) , 

p(t)  • multiplier  corresponding  to  state  variable  inequality  constraint 
X1  4 °* 

Vq  - multiplier  corresponding  to  intermediate  equality  constraint  x^(te)  * 0 
used  to  (formally)  handle  entry  to  a constrained  subarc  with 
xx(t)  - 0. 

v for  i - 1,2,3  * multiplier  corresponding  to  state  variable  terminal 

inequality  constraint  x^(T)  i 0 (x^(T)  » y(T)), 

v (v  ) • multiplier  corresponding  to  state  variable  terminal  inequality 
3 constraint  (T)  £ 1 ($(T)  i 0), 

| * fraction  of  Y-fire  directed  at  X^, 

T " "backwards  time"  from  the  end  of  the  battle;  defined  by  t » T - t, 
i.e.  the  time  remaining  before  the  end  of  battle, 

t ■ "backwards  time"  of  the  first  change  in  the  sign  of  the  switching 
function  v,  i.e.  v(t“T-x.)  ■ 0. 


Characterization  of  an  Optimal  Fire  Distribution  Policj 


Using  Gamkrelidze's  approach  and  considering  (3),  (4),  (8),  (9), 
and  (10),  we  have  that  the  Hamiltonian  is  given  by  [2],  [6],  [11] 


H(t,xt,p1(u)  - “P1+a1y  - p2(l-<t>)a2y  - P3(b1x1+b2x2)  + p4u 


- nL(t)u  + n2(t)u  - u(t){ua1y-t)ia1(b1x1+b2x2)}  , (11) 
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for  $ < 1, 
for  $ • 1, 


and 


for  ♦ > 0, 
for  $ - 0, 


U 


- 0 

i 0 


for  x^  > 0, 
for  - 0. 


We  have  adopted  above  the  following  correspondence  between  state  and 
dual  variables: 


state  variable 


y 

* 


dual  variable 


p3* 

V 


Again,  to  avoid  being  encumbered  with  too  many  symbols,  we  have  only 
considered  one  (i.e.  x^  s 0)  of  the  two  SVIC's  x^»x£  4 0*  The  other 
SVIC  (i.e.  S 0)  is  handled  in  a similar  way.  The  adjoint  system  of 
differential  equations  for  the  dual  variables  is 


dpl  - 
dt 

*1^*  blP3  ' u(t)*al*V 

(12) 

dp2 

dt 

‘ ” b2P3  " u(t)*alV 

(13) 

^3  . 
dt 

~ m + (1-^)*2p2  +h(t)a1u*. 

(14) 

dp4 

dt 

dH 

" Jf  ' (alPl'a2P2)y  ■ M(t)«1(b1x1+b2x2). 

(15) 

The  boundary  conditions  at  t ■ T for  the  adjoint  (or  dual)  variables 
may  be  written 

p^t-T)  - -p  + p2(t-T)  - -q  + v2,  p3(t»T)  ■ r ♦ Vj,  P4(t»T)  - - v5> 
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where  v^  for  i » are  undetermined  multipliers  which  require 

the  specification  of  additional  information  to  be  further  delineated.  To 

* 

this  end,  let  us  consider  the  case  in  which  Y loses  with  T < (i.e. 

T defined  by  y(T)  - 0).  From  the  transversality  condition  H(T,x.(T), 
p^(T),u*(T))  ■ 0,  we  obtain  p^ (T)  - 0.  Then,  we  have  [2],  [21] 

P1(T)  • -p  + Vj.,  P2(T)  - -q  + v2,  p3(T)  - 0,  p^(T)  - - Vj,  (16) 

where 

- 0 for  x^(T)  > 0, 

for  i » 1,2  Wlp0  for  x^T)  ■ 0 but  x^(t)  > 0 for  t < T, 

unrestricted  when  x^(t)  - 0 for  t^  £ t £ T 
with  t^  < T, 


and 


- 0 

i 0 


for  <HT)  > 0, 
for  *(T)  - 0, 


- 0 

* 0 


for  ♦(!)  < 1, 
for  <»(T)  - 1. 


When  x^,x2«y  > 0 and  0 < $ < 1,  the  (extremal)  control  law  is 
determined  by  the  maximum  principle.  Hence,  we  consider 


maximize  H(t,x  ,p  ,u) , 

■V"-*D 


and  this  yields 


l RTI  £°r  > °» 

u*(t)  - j 

’ -R^  for  P^(t)  < 0. 


(17) 


Other  cases  are  handled  in  a similar  manner.  See  [19]  for  a problem  in 
which  the  boundary  conditions  for  the  adjoint  variables  are  worked  out  for 
all  the  battle's  end  states. 
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We  must  further  investigate  the  possibility  of  singular  subarea  (7)  (also 

3H 

see  Chapter  8 in  [2])  on  which  ■ 0 for  a finite  interval  of  time  (so 

3H 

that  all  its  time  derivatives  vanish).  The  condition  that  — * 0 yields 
that  on  a singular  subarc  we  must  have 


p^(t)  - 0. 


(18) 


A ill. 

The  condition  — (jjj)  • 0 then  yields 


alPl(t)  “ a2p2(t) 


(19) 


Proceeding  to  the  next  time  derivative,  we  would  have  on  a singular  subarc 
on  which  (18)  and  (19)  hold  that 

*2  r3H-v 


d' 

dP 


y ’ yp3(*1Va2b2). 


(20) 


From  (20),  we  see  that  a singular  solution  is  impossible,  since  it  is 
impossible  (in  general)  to  have  -~z  - 0 for  a finite  interval  of 

time. 


4.1.  Necessary  Conditions  of  Optimality  on  Constrained  Subarc  for  $ . 

On  a constrained  subarc  on  which  $(t)  ■ 1 for  t £ t £ t^  the 

control  is  determined  by  44  * 0 and  hence 

dt 

u*(t)  • 0 for  t^  < t < t2-  (21) 

3H 

The  multiplier  n^(t)  is  determined  by  the  condition  — • 0 and  hence 

HjU)  - P4 (t) . (22) 

The  requirement  that  n^(t)  4 0 yields  that  on  the  constrained  subarc  we 


must  have 
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P4(t)  i 0.  (23) 

Differentiating  (23)  and  combining  with  (15),  we  obtain 

nx(t)  - y(a1p1-a2p2) , (24) 

ao  that  Gamkrelidze's  condition  n^(t)  <0  [11]  (see  also  [20])  is  only 

satisfied  on  a constrained  subarc  with  4 ■ 1 when 

al(-Pl(t))  a a2(-p(t)) , (25) 

which  the  reader  will,  of  course,  recognize  as  a result  for  the  correspond- 
ing "inertialess"  combat  problem  (see  [14],  [19]).  Denoting  the  time  of 
an  entrance  corner  by  t and  that  of  an  exit  corner  by  t. , the  corner 
conditions  (see  [17]  and  [19]  for  further  discussion,  especially  for 
corners  interior  to  the  state  space  (which  are  not  explicitly  discussed 
here))  yield  that  at  an  entrance  corner  we  have  [10] 

pi(t~)  - Pt<ce)  for  1 * 1.2,3,  (26) 

and 

p4<c;>  - 0 - p4(t+)  - ^(t*),  (27) 

or 

p4(te)  " T1l(te)*  (28) 

where  t^  denotes  a left-hand  limit.  The  reader  should  note  that  (28) 
is  in  consonance  with  (22).  Furthermore,  at  an  exit  corner  we  have 

P1(t”)  - P^t*)  for  i - 1,2, 3, 4.  (29) 

Considering  either  n^t^)  ■ 0 or  H(t~)  ■ H(t*),  we  find  that 
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P4(t“)  - 0 - p4(t^).  (30) 

Considering  (24),  (28),  and  again  n^t^)  * 0,  we  see  that  when  there 
is  an  exit  from  the  constrained  subarc  at  t » t^,  then  (28)  yields 

t, 

+ + (^ 

P4<ce)  " nl(te)  " J y(t)t*2P2(t)  " *1P1<t)>dt  * 0.  (31) 

t 

e 

On  a constrained  subarc  on  which  $(t)  * 0 for  t^  < t < t^  the 
details  are  similar  to  the  above  with  the  control  again  given  by  (21) , 
since  again  ^ - 0.  Determinations  similar  to  the  above  yield 

n2(t)  " "p4(t)»  (32) 

and  that  it  is  necessary  on  the  constrained  subarc  that 

P4(t)  * 0,  (33) 

and 

al("Pl(t>)  * a2<-p2(t)>*  (34) 

the  latter  condition  (34)  being  a consequence  of  Gamkrelidze 's  multiplier 
condition  ^(t)  * 0.  Corner  conditions  similar  to  (26)  through  (30)  also 
must  hold.  When  there  is  an  exit  from  the  constrained  subarc  at  t • t . 
we  find  that 
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4.2.  Necessary  Conditions  of  Optimality  on  Constrained  Subarc  for  . 

On  a conscralned  subarc  on  which  x,  (t)  ■ 0 for  t < t < T the 
,2  1 e 

d X1 

control  is  determined  by  ^2  * 0 which  (along  with  the  requirement  that 
dxl 

- 0)  yields 


u*(t)  -0  for  t^  < t * T, 


(36) 


and 


♦(t)  ■ 0 for  t s I. 


(37) 


The  multiplier  u(t)  is  determined  by  the  condition  -3—  ■ 0 and  hence 


P4(t)  - w(t)a1y  - 0,  (38) 

or  * 

U(t)  - . (39) 

aly 


Differentiating  (38)  with  respect  to  time  and  combining  with  (15) , we 

* 

obtain 


U(t) 


— (alPl-a2P2). 


(40) 


Further  differentiation  and  combination  with  (12) , (13) , and  the  condition 
♦(t)  - 0 yields  that 

P3(c> 

W(t)  - — (a1b1-a2b2).  (41) 


The  necessary  condition  of  optimality  on  a constrained  subarc  of  a second 

. ,k 

order  SVIC  [22]  is  that  (-1)  — £ at  0 for  k ■ 0,1,2,  and  hence  consid- 

dt 

ering  (39) , (40) , and  (41)  we  must  have 


This  result  was  obtained  after  cancellation  of  a term  y(t).  Hence,  a 
different  argument  is  required  when  y(t)  ■ 0.  This  latter  condition, 
however,  only  occurs  at  most  at  a single  isolated  point  t ■ T.  See  [19] 
for  a similar  occurrence  and  further  discussion. 
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P4(t)  2 0,  (42) 

*1(-P1(t))  2 a2(-p2(t)),  (43) 

and  a^  2 a^,  (44) 

since  it  is  readily  shown  that  p^(t)  > 0 for  t < T.  It  is  of  interest 
to  note  that  (43)  and  (44)  have  previously  been  shown  [17]  to  be  necessary 
conditions  of  optimality  for  having  » 0 for  a finite  interval  of  time 
in  the  lnertlalless  combat  problem  (1) . 

As  in  [14],  [19]  let  us  make  the  nonrestrictive  assumption  that 
a^b^  > . This  then  implies  that  it  is  non-optimal  to  have  m 0 

for  a finite  interval  of  time,  since  (44)  must  hold  with  the  sense  of  the 
Inequality  reversed  on  such  a constrained  subarc. 

For  a second  order  SVIC  C(t,xi)  a 0,  we  must  have  at  an  entrance 
corner  to  a constrained  subarc  [10] 

p^tf)  - Pi(t+)  - vQ  |£-  (te)  - U(t+)  {(C)(te)}  for  i - 1 (45) 

and 

H(t;>  . H(t*)  ♦ v0  f£  (te>  + ,<«♦>  £ {(CMC.)},  (M) 

where  [6]  i 0.  Recalling  (5)  and  (6),  we  find  for  the  problem  at  hand 
at  an  entrance  at  t - t to  a constrained  subarc  on  which  x ■ 0 that 

Pl(tT)  - Px(t*)  + v0,  (47) 

Pi(tI)  * Pi(0  for  1 * 2'3'  (A8) 

P4<t”)  • P4C^)  - u(t^)a1y.  (49) 


the  following  hold 
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From  (38)  we  have 

p4(tt} " »*<ti)v»  (so) 

so  chec  (49)  yields 

P - o.  (51) 

Furthermore,  the  corner  condition  (46)  (which  reads  H(t#)  - H(t*))  is 
satisfied  when  (48)  and  (49)  hold.  It  should  be  clear  that  no  trajectory 
can  leave  a constrained  subarc  on  which  x^  • 0 after  entry.  Hence,  we 
omit  discussion  of  the  corner  conditions  at  exit  corners. 

It  will  now  be  shown  that  we  must  have  Vq  > 0.  Considering  the 
nonrestrlctlve  assumption  a^b^  > *2^2*  s''ou^c^  he  c^ear  that  we  must 
have  x. ,x. ,y ,$  > 0 for  0 < t < t (we  might  have  $(t-0)  - 0).  Then 

X im  8 

$(t)  > 0 for  0 < t < t and  *(t)  - 0 for  i.  t with  $(t)  being 
continuous  imply  that  u*(tg)  ■ -R^,  an<^  thus  by  (17)  and  (51) 

P4(t)  <0  for  t € (te-6,te)  with  P4(t”)  - 0,  (52) 


where  & > 0 is  a suitably  chosen  constant,  and  we  have  used  the  fact 
that  it  is  impossible  for  p^(t)  ■ 0 for  a finite  interval  of  time  (this 
was  established  when  we  showed  the  impossibility  of  a singular  solution) . 
Expanding  p. (t)  for  t < t in  a Taylor  series  about  t ■ t , we  find 
that 

dp, 

(te-t)  jf-  (X)  - (-P4(t))  > 0,  (53) 

dp4 

where  t € (t,t#).  Hence,  (t)  > 0 for  all  t € (t#-6ltt#)  where 

0 < « 6.  Recalling  (15)  and  that  y > 0,  we  have 


a1P1(t)  > a2P2(t)  for  t 6 (t*"il»V» 


(54) 


»-e  (igpi  ■ 
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■o  that  In  the  limit  we  have 


alPl(te)  4 *2P2(t^ • 


Next,  we  show  that  we  must  have 


*lpl(te^  > »2p2(te)* 


The  proof  Is  by  contradiction.  Considering  (55),  we  assume  that  a,p.(t  ) 

lie 

- a.p,(t  ).  Again  expand  p. (t)  for  t < t In  a Taylor  series  about 
L L e 4 e 

t • t#.  Recalling  (15)  and  using  the  above  assumption  and  (51),  we  find 


that  for  t < t 


(te't)2  - 


• p4(t)  " 2 dt7_(t) ’ 


where  t € (t,t  ).  Using  the  state  and  adjoint  equations,  we  readily 
€ 

compute  that 
d2P4 

jpr  (t)  * YP3(t)(a1b1-a2b2)  - (ajP^O-a^U) KbjXj+b^) . (58) 

By  the  continuity  of  the  dual  variables  between  corners,  t can  be  chosen 

€(t  -4 , t ) such  that  for  all  7 € (t,t  ) we  have 
® ® 6 

IP"  G>  > o. 

and  hence  by  (57)  we  have  a contradiction  to  (52).  Thus,  (56)  must  hold. 
Next,  we  show  that  we  must  have 


Vi^e)  < *2P2(te)*  (59) 

This  follows  Immediately  from  p3(t)  > 0 for  t < T • ii(t)  > 0 for 
t#  a t < T.  Then  u(t«T)  a 0 m u(t)  < 0 for  t < t < T,  and  reference 
to  (40)  yields  the  desired  result  (59) . 


‘•’•AM. 


Tf'V; 
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* 

The  proof  that  vQ  > 0 now  readily  follows.  First,  we  observe 
u 

that  (48),  (56),  and  (59)  yield 

Vl^e*  > a2P2(te>  “ a2P2(tt)  > alpl(0*  (60) 

or 

p x(t;>  > (61) 

whence  follows  > 0 by  (47).  Moreover,  Is  chosen  so  that  <p  m 0 

* 

precisely  when  x^(tft)  ■ 0* 

5 . Synthesis  of  Extremal  Policy  when  x^(T),x^(T)  > 0. 

In  this  and  the  next  two  sections  we  synthesize  the  extremal  fire 

** 

distribution  policy  for  all  cases  in  which  Y loses  with  T < (the 

same  case  for  which  the  boundary  conditions  for  the  adjoint  variables  were 
given  in  Section  4) . By  the  synthesis  of  the  extremal  control  we  mean  the 
explicit  determination  (using  the  necessary  conditions  of  optimality)  of 
the  time  history  of  the  extremal  control  from  initial  to  terminal  time 
(see  [ 17 ] — [ 19 ] for  further,  more  extensive  discussion). 

The  basic  idea  is  to  trace  extremals  backwards  from  a given 
terminal  state  in  such  a way  as  to  guarantee  the  satisfaction  of  the  initial 

* 

This  multiplier  Vq  arises  because  the  system  loses  two  degrees  of  freedom 
when  it  enters  the  constrained  subarc  (see  pp.  411-412  of  [10]).  For  a first 
order  SVIC,  the  value  of  the  multiplier  y(t^)  at  the  entrance  corner  accounts 
for  the  loss  of  one  degree  of  freedom  by  the  system  upon  entering  the  con- 
strained subarc.  For  a second  order  SVIC,  there  are  two  degrees  of  freedom  i 

lost  this  way  (for  the  problem  at  hand,  x^  ■ 0 and  $ ■ 0 on  the  constrained 
subarc),  one  of  which  is  accounted  for  by  u(t^). 

Other  cases  are  handled  in  a similar  manner.  See  [18]  and  [19]  for  problems 
in  which  this  is  done  for  every  end  state  of  battle. 

By  an  extremal  we  mean  a path  (or  trajectory)  on  which  the  necessary  condi- 
tions of  optimality  are  satisfied  at  every  point  in  time. 
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conditions.  Thus,  it  is  convenient  to  introduce  the  "backwards  time" 

arlable 
d2  d2 


variable  t defined  by  t ■ T - t.  We  observe  that  4-  m - 4-  but 

dt  dr 


dt2  dt' 


It  Is  also  convenient  to  define 


v ( t)  - a1(-p1(t))  - a2(-p2(t)), 


(62) 


so  that  differentiation  and  combination  with  (12)  and  (13)  yield 


dv 


d£m  -P3(0(a1b1-a 2b2) 


(63) 


Then  our  nonrestrlctlve  ass>unption  that  a^b^  > a2b2  yields  that 


(t)  < 0 for  all  t < T, 
at 


(64) 


since  It  Is  easily  shown  that  p^(t)  > 0 for  t < T.  Using  (62),  it  is 


convenient  to  write  (15)  (for  x^  > 0)  as 


4h 

dt 


- yv, 


and  hence 


<*2P. 

3?"  * <blW2)v  - y It- 


dv 


(65) 


(66) 


In  synthesizing  an  extremal  there  are  two  cases  to  consider: 


Case  (a)  ajP  a a2q, 

Case  (b)  a^  < a2q. 

For  Case  (a):  a^p  a a2q,  it  is  convenient  to  first  observe  that 
a Taylor  series  expansion  of  p^(t)  about  T - 0 yields  for  t a 0 

P4(t>  - P4(t-0)  + 

where  7 € (0,t).  In  this  ceee 


dt 


T2  d2p4  -s 

(T“0)  + T dr7^  (T“^* 


(67) 


we  have 
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v(t-0)  - aLp  - a2q  a 0,  (68) 

so  that  considering  (64)  it  is  readily  seen  that 

v(t)  > 0 for  t > 0,  (69) 


and  hence  (65)  and  (66)  yield 


dp4 

(x-0)  - y(T)  (a1p-a2q)  - 0,  (70) 


since  y(T)  - 0 and 

d2P4 

j 2 (t)  > 0 for  t > 0.  (71) 

Furthermore,  there  are  three  subcases  to  be  considered  when 
a^  a a2q: 

Subcase  (al)  $(t“t)  - 0, 

Subcase  (a2)  0 < $(t«T)  < 1, 

Subcase  (a3)  i>(t»T)  - 1. 


We  will  now  show  that  Subcase  (al)  is  not  consistent  with  an  optimal  policy 
and  work  out  details  for  the  other  two  cases. 

Subcase  (al) : ♦(fT)  ■ 0 when  a^p  a a^q. 

Since  $(t"T)  - 0,  (16)  yields  that  p4(x»0)  ■ a 0.  Then  (67), 

(70) , and  (71)  yield  that 


P4(r)  > 0 for  t > 0.  (72) 

If  the  system  would  be  on  a constrained  subarc  for  a finite  Interval  of 
time,  i.e.  f(t)  ■ 0 for  tg  £ t £ T,  then  (72)  is  a violation  of  the 
necessary  condition  of  optimality  (33).  (We  also  note  that  Gamkrelidze's 


necessary  condition  n2(t)  s 0 Is  violated,  since  by  (32),  (65)  and  (69) 
we  have  ^(t)  ■ yv(t)  > 0 for  t(  < t < I.)  If  we  were  not  on  a con- 
strained subarc  for  a finite  interval  of  time,  then  we  must  have  $(x)  > 0 
for:  0 < r < 5 with  $(t“0)  * 0.  This  implies  that  u*(t)  * -R.  for 

I 

0 T < 5^  £ 6,  and  this  is  impossible  by  (17)  and  (72).  Hence  this 
cas«  is  inconsistent  with  an  optimal  policy. 

i Subcase  (a2) : 0 < $(t«T)  < 1 when  a^p  a a^q. 

Since  0 < $(t“T)  < 1,  (16)  yields  p^(t-O)  - 0,  and  (72)  again 

follows.  Then  by  (17)  and  (72)  we  have 


u*(t)  - Ry  for  0 £ t sl  T.  (73) 

Denoting  $(t-0)  by  we  then  have  + R^T  * $(t»T)  <1,  so  that 

this  case  happens  when  T < (1-$q)/R^.  The  extremal  policy  is  then  given 
by 

u*(t)  - Ry  for  0 s t £ T < (1-$q) /Ry . (74) 

For  longer  times  we  must  go  to  the  next  subcase. 


Subcase  (a3) 


[t»T)  ■»  1 when  a p ^ a?q . 


Since  $(t-T)  ■ 1,  (16)  now  yields  p^(t-O)  - £ 0.  It  may  be 

shown  that  a contradiction  arises  unless  - 0.  Hence,  we  must  have 
p^(t^O)  - 0.  If  $(t)  < 1 for  T - 6 £ t < T where  6 > 0,  then  the 
development  of  the  previous  subcase  holds.  If  we  are  on  a constrained 


subarc  with  $(t)  “ 1 for  tg  £ t £ T,  then  by  (24)  and  (62)  we  have 

a a 

h^(t)  ■ -yv(t).  Hence  Gamkrelidze  s necessary  condition  n, (t)  £ 0 is 
satisfied  by  (69).  Thus,  we  can  remain  (in  backwards  progression  at  the 
end  t ■ T)  on  the  constrained  subarc  until  we  have  to  get  off  to  meet 
the  initial  condition  $(t”0)  “ As  we  work  backwards  and  leave  the 
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constrained  subarc  (but  in  forwards  time  enter  at  t ) , the  corner 

e 

condition  (27)  and  a Taylor  series  expansion  of  p^(t)  about  t - t 
yield  for  0 £ t £ to 


P4<t> 


dp4 

"(te-t)  dT 


(te"t)2  d2p4 

(t-te)  + 2 dr^  (t=t)- 


(75) 


where  t 6 (t,te).  Recalling  (65),  (69),  and  (71),  we  see  that  ( t)  a 0 
for  0 £ t £ t so  that  the  rest  of  the  analysis  is  similar  to  that  of 
the  preceding  subcase.  Hence 


when  T i (1-$q)/R^t,  we  have 


for 

0 £ t £ (l-^J/Ry, 

u*(c)  - Ry  and  4>* (t)  = 4> 0 + Ryt, 

for 

(l-^/Ry  < t £ T, 

u*(t)  ” 0 and  ♦* ( t)  - 1. 

(76) 

For 

Case  (b) : a^  < a„q , 

, we  have  that  (recalling  (62)) 

v(t-0) 

- axP  - a2q  < 0. 

(77) 

From  (64)  we  have  — (t)  > 0 for  t > 0 with  v(t)  a continuous 
dr 

function  (see  [2]  and  above  corner  conditions  at  boundary  of  state  space 
(26)),  and  thus  at  some  (backwards)  time  v(t)  must  become  zero.  Denote 
this  "backwards  time"  as  t^.  Thus  v(t-t^)  - 0.  There  are,  again, 
three  subcases  to  be  considered  when  a^p  < a0q: 

Subcase  (bl)  ♦(t-T)  - 0, 

Subcase  (b2)  0 < 4>  ( t— T)  < 1, 

Subcase  (b3)  $(t"T)  ■ 1. 

Analysis  of  these  subcases  is  similar  to  that  given  for  Case  (a)  with 
Subcase  (b3)  being  impossible. 


I 
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Let  us  now  observe  (recalling  (25)  and  (34))  that  in  order  to 
satisfy  Gamkrelidze's  condition  on  constrained  subarcs  with  $ ■ 0 or 
$ “ 1,  we  must  have 


< 

/—N 

ft 

V 

o 

when 

♦(t)  = 1 

for  a 

finite 

interval 

of 

time , 

(78) 

and 

V(t)  £ 0 

when 

♦(t)  - 0 

for  a 

finite 

interval 

of 

time . 

(79) 

We  have  previously  noted  in  Section  4.1  the  correspondence  of  these  results 
to  those  for  "inertialless"  combat.  We  now  consider  the  case  when 
$(t-T)  * 0.  Let  t°  denote  the  (forward)  time  when  the  system  enters 
a constrained  subarc  with  <f>  — 0 ; similarly  t*  denotes  the  time  of 
leaving  one  with  $ ■ 1.  We  further  assume  that 

t(t)  - 0 for  t°  £ t £ T.  (80) 


We  now  prove  that  it  is  impossible  to  have  v(t=t°)  - 0;  in  fact, 

v(t)  must  be  <0  before  0.  We  begin  by  observing  that  $(t“t°)  “ 0 

with  0 < $(t)  < 1 for  t°  - <5  < t < t°  where  5 > 0.  Hence,  u*(t)  ■ -R, 

e e L 

and  p. (t)  £ 0 by  (17)  for  t°  - 6,  < t < t°  where  0 < 6.  £ 6.  Con- 

4 e 1 e 1 

sidering  a Taylor  series  expansion  about  t =*  t°  and  (27)  , (65)  , and  (66)  , 

we  have  for  t £ t° 
e 


(t  -t)z 

((t)  - (t°-t)y(t°)v(t°)  + — ^ ( (b1x1+b2x2)v(?)  - y(£)  ^ ( ~)  } , 


(81) 


where  t”  € (t,t°).  Considering  that  T < t° , (64),  and  (81),  it  is 

easily  seen  that  v(t^)  i 0 m p^(t)  > 0 for  t < t° , which  is  impossible 
by  the  above.  Hence, 


v(t-t°)  < 0. 
e 


(82) 
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Now,  It  is  readily  shown  that  for  tj  s.  t £ t°,  p. (t)  - 

x.  e 4 

so  that  recalling  (30) 


t° 

re 


y(s)v(s)ds 


P4(tj[+)  * ( y(s)v(s)ds . 


(83) 


Then,  the  continuity  of  v(t)  , (64)  and  (82)  yield  that  v(t*)  > 0.  Denote 

the  time  at  which  v - 0 as  T - t.  so  that  v(t»T-T  ) = 0.  Then  since 

•t  1 i 

we  also  have  p^(t)  ■ y(s)v(s)ds,  it  follows  that  p^(t)  < 0 for 

tl 

t*  < t < t°  and  hence  by  (17) 


for  tj  < t < t°. 

e 


u.(t)  - 

It  follows  that  t°  - t^  * l/®!/  ^e  t'*'mes  and  are  determined 

by  the  conditions 


1 - Ti  € (t£,t°)  where  v(t-T-t1)  - 0, 


(84) 


and 


t° 

re 


y(s)v(s)ds  - 0, 


(85) 


which  may  be  written  as 

T-T) 
1 


y (t)v(t)dt 


t° 

re 


T-t, 


y(t) v(t)dt . 


(86) 


The  relationship  of  the  times  t* , T-t^,  and  to  the  time  histories 

of  ♦(t)  and  v(t)  are  shown  in  Figure  1. 


Omitting  further  details,  we  reach  an  Important  conclusion;  for  the 
"inertial"  combat  (2)  one  begins  to  redistribute  fire  earlier  in  forward 
time  (anticipating  changes  in  target  priority)  than  in  the  corresponding 
"inertialless"  case  (1).  Again,  the  reader  is  referred  to  Figure  1 for 
motivation  of  this  statement. 

The  above  considerations  on  tracing  extremals  backwards  from  the 
various  terminal  states  of  battle  are  summarized  in  Table  1.  This  table 
shows  from  which  of  the  end  states  extremals  lead.  An  entry  like  "possible 
(but  not  too  likely)"  or  "possible  (but  unlikely)"  means  that  the  domain 
of  controllability  for  extremals  to  that  end  state  is  a "rather  small" 

*By  the  domain  of  controllability  for  extremals  to  an  end  state  we  mean  the 
set  of  points  in  the  initial  state  space  from  which  extremals  lead  to  the 
terminal  state. 
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Table  I.  Possible  End  States  of  Battle  for 
Extremals  when  x^D.x^T)  > 0. 


♦(T)  - 0 

(on  constrained  subarc 
for  finite  time  Interval) 


♦ (T)  - 0 

(but  *(t)>0  for  T-6<t<T) 


0 < *(1)  < 1 


*(T)  - 1 

(on  constrained  subarc 
for  finite  time  Interval) 


<P(T)  - 1 

(but  ♦ ( t ) < 1 for  T-6<t<T) 


alP  * a2q  alP  a2q 


impossible 

possible 

(and  quite  likely) 

Impossible 

possible 
(but  unlikely) 

possible 

(but  not  too  likely) 

possible 

(but  not  too  likely) 

possible 

(and  quite  likely) 

impossible 

possible 
(but  unlikely) 

impossible 
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subset  of  the  initial  state  space  in  contrast  to  an  entry  like  "possible 
(and  quite  likely)"  for  which  the  corresponding  set  of  Initial  conditions 
is  "much  larger."  It  has  not  been  possible  to  develop  explicit  formulas 
for  these  domains  of  controllability  (as  done,  for  example,  in  [14],  [19]) 


6 . Synthesis  of  Extremal  Policy  when  x^(T)  - 0 and  x^ (T)  > 0 . . 
There  are  two  cases  to  consider: 

Case  (a)  on  constrained  subarc  for  finite  interval  of  time, 
Case  (b)  x^(t)  > 0 for  t < T. 


For  Case  (a)  : x^(t)  ~ 0 for  t^  a£  t £ T with  t^  < T,  it  is 
clear  that  we  must  have  $(t)  ■ 0 for  t^  £ t £ T so  that  integration 
of  the  adjoint  equations  (13)  through  (IS)  and  (63)  with  the  boundary 
conditions  (16)  yields  that  for  t^  £ t £ T we  have 


P2(t)  - -q  cosh/a2b,  (T-t), 

(87) 

p 3 ( t ) * q^^sinh  ^2b2  (T-t), 

(88) 

v(t)  - v(T)  + (a^b^-a^bj) (cosh  /a^  (T-t)  - 1}  with  v(T)  a 0, 


the  requirement  that  v(T)  a 0 being  a consequence  of  (43) . We  also  have 


by  (40)  and  (62)  that 


u(t) 


u(T) 


v(s)ds 


with 


U(T)  a 0. 


(90) 


Recalling  our  nonrestrlctive  assumption  that  a^b^  > —2—2  ancl  » 
consideration  of  (89)  yields  that 


(89) 
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p^(t)  > 0 for  t^  < t < T with  p^(t-T)  ■ 0, 
and  v(t)  > 0 for  sC  t < T with  v(t-T)  2 0. 

Hence,  we  see  that  the  necessary  conditions  of  optimality  (42)  through 
(44)  are  always  satisfied  on  the  constrained  subarc.  Thus,  there  are  no 
restrictions  on  when  such  an  extremal  can  occur. 

We  next  show  that  we  must  have  v(t^)  < 0.  The  proof  is  by  con- 
tradiction. First,  we  observe  that  x^t)  > 0 for  t < t^  and  x^(t»t^)  - 0 
imply  that 


u*(t)  ■ -R^  for  t^  - 6 < t < t^  where  6 > 0.  (91) 


If  we  had  v(t^)  i 0,  then  (63)  and  the  fact  that  p^(t)  > 0 for  t < T 
(which  follows  from  (88))  yield  that  v(t)  > 0 for  t < t^.  This  yields 

p^(t)  > 0 for  t < t^  by  (65)  and  the  condition  (51)  that  p^(t^)  - 0. 

However,  (91)  is  impossible  if  p^(t)  > 0. 

It  should  be  noted  that  v(t^)  < 0 and  v(t*)  > 0 guarantee  that 

* 

Vq  > 0,  since  from  (47),  (48),  and  (62)  it  follows  that 


v0  “ ^ {v(tt>  * v(ti)}- 


It  should  be  recalled  that  Vq  is  chosen  so  that  $ * 0 when  x^(t^)  ■ 0. 
The  value  of  vQ  depends  on  x°,  x^,  yQ,  ♦q,  and  T^  The  multiplier 
v,  is  unrestricted  and  is  chosen  so  that  v(T)  ■ (a^p-a^q)  - a^v^  * 0. 

Considering  the  corner  conditions  (47) , (48)  and  (51) , we  have  shown 

chat 


This  condition  was  shown  to  be  necessary  for  optimality  in  Section  4.2. 
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?1(t")  < 0,*  p2(t”)  < 0,  p3(t^)  > 0,  p4(t3)  - 0,  v(t^)  < 0.  (92) 

Further  details  for  0 £ t < in  the  backwards  synthesis  are  similar 
to  those  given  for  Case  (b)  in  Section  5 and  are  therefore  omitted.  Some 
possibilities  for  the  synthesized  extremal  control  are  shown  in  Table  II. 
Other  variations  in  the  form  of  the  synthesized  extremal  control  are 
possible,  and  the  reader  should  have  no  difficulty  in  identifying  them. 


For  Case  (b) : x^(t)  > 0 for  t < T,  there  are  three  subcases  to 

be  considered: 

Subcase  (bl)  $(t”T)  ■ 0, 

Subcase  (b2)  0 < $(t*T)  < 1, 

Subcase  (b3)  $(t«T)  ■ 1. 

Further  analysis  yields  the  results  shown  in  Table  III.  This  shows  from 
which  of  the  end  states  extremals  lead.  We  will  now  sketch  how  these 
results  were  obtained. 

Subcase  (bl) : »(t*T)  - 0. 

Since  $(t«T)  * 0,  (16)  yields  that  p4(t**0)  ■ Se  0.  It  is  clear 

that  we  must  have  $(t)  > 0 for  t € (T-6,T)  for  some  6 > 0.  Hence, 
by  (17)  and  (20) 


u*(t)  - for  t 6 (T-61,T)  c (T-6,T) . 


(93) 


We  now  prove  that  p4(t*0)  ■ 0.  The  proof  is  by  contradiction.  If 
P4(t"0)  > 0,  then  p^(t)  > 0 for  t € (T-62,T)  and  this  contradicts  (93) 


s 9W 

To  astablish  this  result  one  makes  the  identification  p. (t)  ■ . , ■> , 

where  W denotes  Bellman's  optimal  value  function.  It  follows1*  1^ 

that  p.(t)  < 0,  since  addition  of  more  X.  at  t cannot  help  out  reduce 

Y's  optimal  return.  A Justification  of  this  argument  is  given  in  [18]. 


30 


Table  II.  Soh  Possibilities  for  Synthesized  Extremal  Controls  and 
Collateral  Information  for  Case  in  which  x. (T)  - 0 (On 
Constrained  Subarc  for  Finite  Time  Interval;  and  x,(T)  > 0 


(Must  Have  v(T)  a 0) . 

Case  (1). 


time « t 

v(t) 

t-0 

>0 

>0 

OK^t1 

>0 

>0 

0 

>0 

«! 

>0 

>0 

ti<t<ti 

>0 

>0 

«T 

0 

>0 

7+ 

tmtt 

0 

>0 

tj<t<T-r^ 

<0 

>0 

t-T-x^ 

<0 

0 

T-Tl<e<tl 

<0 

<0 

tmtl 

0 

<0 

t-ti 

>0 

>0 

tx<t<T 

>0 

>0 

t-T 

0 

>0 

Case  (2). 

time,  t 

V(t) 

t-0 

>0 

>0 

0<t<t 

>0 

>0 

_■ 

t-t" 

0 

>0 

1 

t-t 

0 

>0 

s 

t <t<T-x, 

<0 

>0 

s 1 

t-T-x^ 

<0 

0 

T-r1<t<t1 

<0 

<0 

t-ti 

0 

<0 

t-t+ 

>0 

>0 

t,<t<T 

>0 

>0 

t-T 

0 

*0 

Casa  (3). 

time,  t 

P4(t) 

v(t) 

t-0 

*0 

>0 

0<t<T-X| 

<0 

>0 

t-T-x^ 

<0 

0 

T-r^<t<tj 

<0 

<0 

ftl 

0 

<0 

>0 

>0 

t.<t<T 

>0 

>0 

t-T 

0 

*0 

U*(t) 

±1 il 

0*4*1 

>0 

*u 

0<4*1 

>0 

■o 

1 

>0 

0 

1 

>0 

0 

1 

>0 

0 

1 

>0 

-*L 

1 

>0 

_rl 

0<4<1 

>0 

_rl 

0<^<1 

>0 

A 

0<*<1 

>0 

-*L 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

U*(0 

♦ (t) 

iilLl 

0s4<l 

>0 

■u 

0<*<1 

>0 

*u 

0<$*1 

>0 

_rl 

0<**1 

>0 

-*L 

0<$<1 

>0 

-*L 

0<4<1 

>0 

0<*<1 

>0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

U*(t) 

Al£l 

Xilil 

“*L 

0<^*1 

>0 

0<$<1 

>0 

0*4*1 

>0 

0*4*1 

>0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

3 


Table  III.  Possible  End  States  of  Battle  for 

Extremals  when  r.^(T)  ■ 0 (But  x^(t)  > 0 
for  t < T)  and  x2(T)  > 0. 


alP  * a2q 


< a2q 


♦(T)  - 0 

(on  constrained  subarc 
for  finite  time  Interval) 


♦<T)  - 0 

(but  $(t)>0  for  T-6<t<T) 


0 < $(T)  < 1 


*(T)  - 1 

(on  constrained  subarc 
for  finite  time  interval) 


♦(T)  - 1 

(but  $(t)<l  for  T-6<t<T) 
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by  (17).  Furthermore,  we  must  have  v(T)  < 0.  Again,  the  proof  is  by 

dw 

contradiction.  Firat,  we  remark  that  by  considering  p3(t)  ■ ^see 

[18]  for  further  discussion)  we  obtain  that  p^(t)  > 0 for  t < T.  Thus, 
dv 

by  (63)  we  have  3—  (x)  > 0 for  t > 0.  If  we  had  v(T)  s 0,  then  we 
aT 

would  have  v(t)  > 0 for  t < T,  and  hence  p^(t)  > 0 for  t 6 (T-d^.T) 

via  (65)  and  P^(T)  ■ 0.  However,  by  (17)  this  contradicts  (93). 

By  (16)  we  see  that  v(T)  < 0 » — (a.  p-a_q)  < v,  ip,  the  latter 

a^  1 i 1 

inequality  a consequence  of  requiring  p^(T)  £ 0.  It  is  clear  that 
can  always  be  chosen  to  satisfy  the  above  conditions  regardless  of  whether 
a^p  2:  a2q  or  a^p  < a^q.  Thus,  this  subcase  is  always  possible  for  the 
appropriate  initial  values  of  the  state  variables.  Furthermore,  we  have 

?1(T)  £ 0,  p2(T)  < 0,  p3(T)  - 0,  p4(T)  - 0,  v(T)  < 0, 

so  that  the  synthesized  extremal  control  function  can  take  any  of  the  forms 
shown  in  Table  III  for  0 £ t £ t^,  the  realization  of  any  particular 
form  being  dependent  upon  the  state  variable  Initial  conditions. 

Subcase  (b2) : 0 < $(t"T)  < 1. 

Since  0 < $(t*T)  < 1,  (16)  yields  that  p4(t»0)  - 0.  Moreover, 
for  0 < $(T)  £ 1 the  transversality  condition  H(T)  ■ 0 no  longer  holds, 
since  when  x^(T)  • 0 (■y(T)),  variations  in  control  du  cannot  Increase 

T because  this  would  lead  to  violation  of  the  constraint  x^  2 0 if  the 
planning  horizon  were  extended  to  T + dT  with  x^(T)  ■ 0 and  $(T)  > 0. 
Then,  a one-sided  version  of  the  usual  variational  argument  [2]  yields 
(after  dropping  some  terms)  dJ  - H(T)dT  £ 0 with  dT  £ 0,  where  J 
denotes  the  (augmented)  return  functional.  This  yields  H(T)  2 0 and 
consequently  p3(T)  £ 0.  Again  using  the  argument  which  considers 
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P3(X)  ■ 3^Yy  ^18^»  ic  foll°ws  that  P3(I)  * 0 (and  also  P3(t)  > 0 
for  t < T) . 

Now,  v(t*0)  - (a^p-a2q)  - a^v^  where  0 a s p,  the  latter 

Inequality  being  a consequence  of  requiring  p^(T)  at  0.  For  a^p  2 a2q, 

we  can  have  v(t-0)  either  i 0 or  <0.  When  v(t-0)  i 0,  the  resulting 

synthesized  extremal  control  takes  a form  similar  to  that  shown  in  Table  IV 

* 

below.  When  v(t-0)  <0,  it  takes  any  of  the  forms  shown  in  Table  II 
for  0 s t S In  all  cases  is  chosen  so  that  x^(T)  - 0.  The 

realization  of  the  synthesized  extremal  control  depends  upon  the  state 
variable  initial  conditions. 

Subcase  (b3) ; »(t»T)  - 1. 

Since  $(t“T)  - 1,  (16)  now  yields  p^(t“0)  - -v^  £ 0.  If  <p ( t)  < 1 

for  T - 5 £ t < T where  6 > 0,  then  previous  arguments  (i.e.  proof  by 
contradiction)  yield  that  p^(t“0)  ■ 0.  Next,  we  show  that  we  must  have 
v(t-T)  s 0.  The  proof  is  by  contradiction.  First,  we  observe  that 
$(t)  < 1 for  T - 6 £ t < T implies  that 

u*(t)  - Ry  for  t € (T-^.T)  c (T-d  ,T) . (94) 

If  v(T)  < 0,  then  v(t)  < 0 for  t 6 (T-d^.T).  Considering  a Taylor 
series  expansion  about  t - T,  we  obtain  P^(t)  ■ (T-t)y(t)v(t)  where 
t € ( t ,T) , since  p^(T)  - 0.  But  then  t € (T-62,T)  f>  (T-d^T)  yields 
p^(t)  < 0 and  this  contradicts  (94)  by  (17).  Since  v(T)  - (a^p-a^)  - 
a^v^  2 0 where  at  0,  it  follows  that  this  subcase  with  4(t)  < 1 

for  t < T is  only  possible  when  a^p  a a2q. 

If  we  are  on  a constrained  subarc  with  +(t)  * 1 for  t*  a t & T, 
then  (23)  and  (25)  must  hold.  The  former  yields  p^(t-O)  ■ 0,  while  the 

( 

This  is  the  only  case  possible  when  a^p  < a?q. 
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latter  yields  0 < £ — (a1p-a2q)  so  that  this  subcase  with  41  (t)  ■ 1 

for  t^  * t £ T Is  only  possible  when  a^p  2 a^q.  The  further  synthesis 
of  the  extremal  control  now  follows  previous  arguments.  The  synthesized 
extremal  control  Is  shown  in  Table  IV. 


Table  IV.  Synthesized  Extremal  Control  and  Collateral  Information 


for  Case  in 

which  x^ 

(T)  - 

0 (But 

x^(t)  > 0 for 

t < T) 

and  x2(T)  > 

0 with 

♦ (t) 

- 1 for 

tl  £ t £ T. 
e 

time,  t 

£4X1! 

v£tl 

u*(t) 

t£tl 

t-0 

>0 

>0 

0£$<1 

>0 

0<t<t! 

e 

>0 

>0 

*U 

0<4<1 

>0 

t-t1" 

t-J+ 

e 

0 

>0 

0 

1 

>0 

>0 

>0 

0 

1 

>0 

t*<t<T 

e 

>0 

>0 

0 

1 

>0 

t-T 

0 

aO 

0 

1 

0 

Note:  This  case  is  only  possible  when  a^p  k a^q. 

7 . Synthesis  of  Extremal  Policy  when  x^(T)  > 0 and  x„(T)  - 0. 

When  x^(T)  - 0,  we  must  have  x^(t)  > 0 for  t < T,  since  it 

is  nonoptlmal  (see  Section  4.2  above)  to  be  on  a constrained  subarc  with 
x^  - 0 for  a finite  interval  of  time.  There  are  then  three  cases  to  be 
considered: 


Case 

(a) 

♦(t-T)  - 0, 

Case 

(b) 

0 < ♦(t-T^  < 1 

Case 

(c) 

♦(t-T)  - 1. 

J 

: 

I 


4 


1 


- 


if 


J 
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Further  analysis  now  yields  the  results  shown  in  Table  V.  This  shows 
from  which  of  the  end  states  extremals  lead.  The  symmetry  of  these  results 
(interchange  x^  and  x2)  in  relation  to  those  shown  in  Table  III  for 
x^(T)  » 0 but  x^(t)  > 0 for  t < T should  be  noted.  We  will  now  sketch 
how  these  results  were  obtained. 

For  Case  (a)  : «» ( t»T ) ~ 0.  (16)  yields  that  p^(t-O)  - a 0. 

Observing  that  #(t)  > 0 for  t € (T-6 ,T)  again  implies  (93),  it  follows 

dP  A 

by  previous  arguments  that  p. (t-0)  “ 0.  Also,  (93)  implies  that  — (t)  < 0 

4 ax 

for  t 6 (0,6.,)  C (0,5^),  and  hence  v(tm0)  < 0 by  (65).  Observing  that 
v(t“Q)  * (a^p-a,q)  + *2S)2’  foH°w9  that  this  case  with  $(t)  > 0 for 
t < T is  only  possible  for  a^p  < a2q.  The  synthesized  extremal  control 
takes  the  form  shown  in  Table  II  for  0 £ t £ t^ . 

If  we  are  on  a constrained  subarc  with  $(t)  » 0 for  t°  £ t £ T, 
then  (33)  and  (34)  must  hold,  whence  it  follows  that  p^(t=*0)  ■ 0 and 

v(t-0)  ■ (a^p-a^q)  + *2^2  £ 0 or  0 * ^2  * a~  (a2<T“"aip^  • Then  p2(i*0)  =* 

-q  + V-  < 0 so  that  we  must  have  v(T)  < 0,  since  for  t°  £ t £ T we 
2 <q-v,> 

have  v(t)  - v(T)  + (a.b  -a0b0)  — r — — {cosh  ^a0b^  (T-t)  - 1}  and  v(t)  £ 0 

11  2 2 Dy  2 2 

* 1 

by  (34)  and  (62).  Thus,  0 £ v.  < — (anq-a.p)  so  that  this  case  with 

2 ^2  2 1 

t(t)  ■ 0 for  tg  £ t £ T Is  only  possible  when  a^p  < a,q.  The  synthesized 
extremal  control  is  shown  in  Table  VI. 

For  Case  (b) : 0 < $(fT)  < 1.  (16)  yields  that  p^(x-O)  » 0.  If 

a^p  % a2<*’  then  v(T)  2 0.  The  requirement  that  p2(T)  £ 0 yields 

0 s v_  £ q so  that  by  (14)  we  have  p,(t)  > 0 for  t < T,  whence  (t) 

i J dt 

> 0 for  all  t > 0.  Hence,  v(t)  > 0 for  t > 0, 


and  the  synthesized 


Table  V.  Possible  End  States  of  Battle  for 


Extremals  when  x^(T)  > 0 and  x^d)  ■ 0 
(But  x^(t)  > 0 for  t < T) . 


aLP  i a2q 


aLP  < a2q 


♦ (T)  - 0 

(cn  constrained  subarc 
for  finite  time  interval) 


*(T)  - 0 

(but  $(t)>0  for  T-d<t<T) 


0 < $(T)  < 1 


♦(T)  - 1 

(on  constrained  subarc 
for  finite  time  interval) 


♦ (T)  - 1 

(but  ♦ ( t ) <1  for  T-<S<t<T) 
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Table  VI.  One  Possibility  for  Synthesized  Extremal  Control  and 
Collateral  Information  for  Case  in  which  x^(T)  > 0 


and  x^(T) 

■ 0 (but 

o 

A 

U 

N-' 

cx 

X 

for  t < T)  With 

♦ <t)  - 0 

for  t°  s t 
e 

£ T. 

time,  t 

v(t) 

u*(t) 

X^(t) 

t-0 

>0 

>0 

0£$<1 

>0 

Octtt1 

e 

>0 

>0 

% 

0<*<1 

>0 

t-ti_ 

e 

0 

>0 

*u 

1 

>0 

i + 

t-t* 

e 

>0 

>0 

0 

1 

>0 

t1<t<t.1 
e l 

>0 

>0 

0 

1 

>0 

t-t1" 

l 

0 

>0 

0 

1 

>0 

c»tl+ 

t 

0 

>0 

-*L 

1 

>0 

t1<t<T-t, 
l 1 

<0 

>0 

-*L 

0<$<1 

>0 

t-T-! 

<0 

0 

0<$<i 

>0 

T-t  <t<t° 

1 e 

<0 

<0 

0<<^<  1 

>0 

t«t°~ 

e 

0 

<0 

0 

>0 

of 

t-t 

e 

<0 

<0 

0 

0 

>0 

t°<t<T 

e 

<0 

<0 

0 

0 

>0 

t-T 

0 

<0 

0 

0 

0 

Notes:  (1) 

This  case  is 

only  possible  when  a^p 

< a2q- 

(2)  Variations  in  the  synthesized  extremal  control  analogous 
to  those  shown  in  Table  II  are  possible. 
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control  is  as  shown  In  Table  IV  for  Ostst'.  If  a,  p < a„q,  then  we 

e 1 2 

can  have  either  v(T)  a 0 or  v(T)  < 0.  The  former  case  has  just  been 
discussed,  while  the  latter  case  yields  a synthesized  extremal  control  like 
one  of  those  shown  In  Table  II  for  0 £ t £ t^. 

For  Case  (c) : ♦(t-T)  ■ 1,  (16)  yields  that  p^(t-O)  ■ £ 0. 

It  is  clear  that  we  must  have  $(t)  < 1 for  t € (T-6,T),  since  x2(t)  > 0 

for  t < T and  x^(T)  ■ 0.  Previous  arguments  readily  yield  p^(T*0)  ■ 0 

and  0 £ £ q (since  p^(T)  £ 0) . If  a^p  a a2q,  then  v(T)  a 0 and 

further  results  are  similar  to  those  of  the  previous  case.  If  a^p  < a2q, 
then  v(T)  is  either  a 0 or  <0.  The  case  in  which  v(T)  a 0 has 

just  been  discussed.  If  v(T)  < 0,  this  leads  to  p^(t)  < 0 for 

t € (T-fi2*T).  By  (17)  this  is  impossible,  however,  since  we  must  have  (94) 
hold,  since  $(t)  < 1 for  t € (T-6,T).  Thus,  this  case  is  always  possible 
for  the  appropriate  initial  values  of  the  state  variables,  although  we  must 
always  have  v(T)  a 0.  The  synthesized  extremal  control  is  the  same  as  for 
Case  (b)  with  v(T)  a 0. 

8 . Determination  of  the  Optimal  Fire  Distribution  Policy. 

It  remains  to  discuss  how  the  optimal  fire  distribution  policy  may 
be  determined  from  among  the  extremal  control  policies  developed  in  the 
previous  sections.  Two  ways  of  proving  the  optimality  of  an  extremal 
trajectory  are  as  follows  (see  (17],  [18]): 

(a)  show  that  sufficient  conditions  of  optimality  are  satisfied  on 
the  extremal, 

(b)  by  citing  the  appropriate  existence  theorem,  show  that  an  optimal 
control  exists  for  the  problem  at  hand;  there  are  two  further 
subcases:  (1)  if  the  extremal  is  unique,  then  it  is  optimal  or 
(2)  if  the  extremal  is  not  unique  and  only  a finite  number  exist. 
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then  the  optimal  trajectory  is  determined  by  considering  the 
finite  number  of  alternatives. 

In  the  first  case  there  are  both  local  and  global  sufficiency  theorems 
to  be  considered.  Neither,  however,  is  convenient  to  apply  to  the  problem 
(2)  at  hand.  The  usual  control  theory  sufficient  conditions  for  a local 
maximum  (see  pp.  181-184  of  [2])  are  not  satisfied,  since  the  problem  (2) 

g2jj  ft 

is  singular  (in  the  sense  that  = 0).  Sufficient  conditions  for  a 

global  maximum  depend  upon  the  appropriate  functions  being  concave  and 
the  planning  horizon  being  fixed  in  length  [4],  [9].  The  latter  condition 
is  not  satisfied  for  (2),  since,  for  example,  the  battle  can  end  by  Y 
being  annihilated  at  any  time  before  T^. 

Thus,  as  in  earlier  papers  [14],  [18],  [19],  we  are  again  led  back 
to  the  enumeration  of  all  extremals  in  various  regions  of  the  state  space 
(i.e.  the  intersections  of  the  domains  of  controllability  for  extremals 
leading  to  the  various  terminal  states  of  battle  (see  [14],  [19]))  and 
comparison  of  corresponding  returns.  The  author  has  not  been  able  to  develop 
analytic,  closed-form  results  for  the  integration  of  the  state  equations  (2) 
in  the  general  case  (much  less  for  the  determination  of  domains  of  con- 
trollability or  computation  of  extremal  returns).  Thus,  it  has  not  been 

possible  to  analytically  determine  the  optimal  control  from  among  the  candi- 

an 

date  extremal  controls  for  the  problem  at  hand  as  was  done  tn  [14]  (see 
also  [19]). 

Moreover,  the  existence  of  an  optimal  control  readily  follows  from 
the  control  variable  u being  uniformly  bounded  (see  Corollary  2 on  p.  262 

[ 

Recently,  conditions  sufficient  for  a local  maximum  have  been  developed  for 
the  singular  control  problem.  These  are,  however,  essentially  impossible 
to  check  for  the  problem  at  hand  (see  [18]). 

t 

For  given  initial  and  parameter  values  this  may  be  done  numerically  by 
following  the  steps  outlined  in  [14]  (or  [IS]). 
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of  [8]).  The  uniform  boundedness  of  responses  Is  a consequence  of  u 
being  required  to  lie  in  a compact  set  (i.e.  — < -R^  i u < < +■. 

Let  us  observe  that  for  -R^  ■ — and  Ry  ■ +*  problem  (2)  is  equivalent 
to  problem  (1),  the  "inertialless"  combat  problem.  In  this  case  there 
will  be  jumps  in  state  variable  $ in  problem  (2) . Additional  consid- 
erations are  now  required  in  the  development  of  necessary  conditions  of 
optimality  (see  [12],  [23],  [24]).  It  should  be  pointed  out,  moreover, 
that  the  existence  theorems  of  Lee  and  Markus  [8]  (and  others)  only  apply 
for  admissible  trajectories  which  are  absolutely  continuous.  Hence,  they 
no  longer  can  be  invoked  to  insure  the  existence  of  an  optimal  control  when 
-R^  ■ -m  and  R^  - +«. 

9 . More  General  Redistribution  of  Fire  Model. 

In  the  model  (2)  considered  above  the  rate  of  redistribution  of 
fire  by  Y firers  was  assumed  to  be  bounded,  i.e.  -R^  £ ^ & R^,  and 
not  to  be  dependent  upon  the  distribution  of  fire.  It  is  of  considerable 
interest  and  importance  for  us  to  continue  our  investigation  of  the 
dependence  of  the  structure  of  the  optimal  fire  distribution  policy  upon 
model  form  (see  [16]).  The  above  simple  model  (2)  for  redistribution  of 
fire  is  equivalent  to 

3t  ' Fl(u) • (95> 

where  (a)  F^(u«0)  ■ 0 and  (b)  F^(u)  is  a concave  function  for  u € [-R^.R^] 

with  (u“R^)  > 0. 

Let  us  consider  the  more  general  case  in  which  the  rate  of  redistri- 
bution of  Y-fire  is  bounded  and  also  dependent  upon  the  distribution  of 
fire.  Thus,  we  consider  the  model 

*See  also  [17],  [18]. 
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^•-F(*,u),  (96) 

where  F($,u)  reflects  the  ability  of  Y firers  to  redistribute  their 
fire  over  X-target  types.  We  will  see  below  that  the  functional  form  of 
F($,u)  (as  long  as  it  is  not  pathological)  does  not  affect  the  structure 
of  the  optimal  fire  distribution  policy,  although  the  time  history  of  the 
distribution  of  Y-fire,  i.e.  $(t)  for  0 £ t £ T,  does  vary,  of  course, 
with  changes  in  F($,u). 

What  are  appropriate  properties  to  postulate  for  F($,u)  in  order 
to  model  the  real  world?  First  of  all,  it  must  be  possible  to  keep  the 
distribution  of  fire  constant.  Thus,  we  stipulate  that  if  u * 0,  there 
is  no  redistribution  of  fire.  Also,  if  u > 0 (<0) , then  $ increases 

(decreases)  (but  the  rate  of  change  is  bounded) . It  seems  appropriate  to 
postulate  that  there  are  "stragglers"  in  redistributing  their  fire,  as 
$ approaches  zero  (or  one)  its  rate  of  change  decreases.  Finally,  we 
assume  that  all  the  Y firers  can  shift  their  fire  in  a finite  interval 
of  time. 

We  therefore  make  the  following  assumptions  about  F(<fr,u): 

(Al)  for  all  * € [0,1] 

!-F  £ F(<fr,u)  < 0 for  -EL  £ u < 0, 

F($,u)  ■ 0 for  u * 0, 

0 < F($,u)  £ F..  for  0 < u £ EL 

where  Fy.Fy  >U0, 

(A2)  F(<p,u)  is  piecewise  in  its  arguments  for  all 

* € [0,1]  and  u € [-R^.R^], 
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(A3) 


for  fixed  $ 

_RL  * u * *u 


€ [0,1], 

with 

3u 


F(4»,u)  is 

(♦.u-Ry)  > 


concave 

0, 


in 


u 


for 


(A4) 


F(*,u)  is  a strictly  function  of  * for 

fixed  u such  that 


An  example  of  such  a function  is 


, u(e  +$) 

for  -R^  s u < 0, 

F($,u)  - 

(97) 

* u(l+e2-<J>) 

for  0 £ u £ Ry, 

where  e^,e2  > 

Then  we  have,  for  example. 

$(t)  - 

"RL^t_t0) 

+ (c^+^q) e when  u(s)  - 

for  tQ  * s £ t. 

We  now  show  that  for  problem  (2)  when  (96)  is  used  with  F($,u) 
satisfying  (Al)  through  (A4) , the  structure  of  the  optimal  fire  distribu- 
tion policy  is  the  same  as  for  problem  (2)  (with  4^  ■ u) . The  Hamiltonian 

at 

in  this  esse  is  given  by 

H(c,x1,pt,u)  - -PjMjY  - p2(l-$)a2y  - p^bjXj+b^)  + p4F($,u) 

- n1(t)u  + n2(t)u  - u(t){F($  ,u)a^y  - ♦a^bjXj+b^) } , (98) 

so  that  (15)  is  now  replaced  by 

dp 

d !t  * PlV  ’ P2»2y  ’ P4  I?  + V ’ *l(blVb2X2)}*  (99) 


Of  course,  #(t)  and  dependent  quantities  differ  in  their  particular  form. 
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When  x^x^.y  > 0 end  0 < + < l,  the  extremal  control  ie  again 
given  by  (17)  becauae  of  assumption  (A3).  Again,  it  will  be  shown  that 

3F 

there  is  no  singular  solution.  This  is  proved  as  follows.  Since  i 0, 
3H 

the  condition  — ■ 0 for  a finite  Interval  of  time  again  leads  to  (18) 
and  ^r(|“)  ■ 0 on  the  singular  subarc  so  that  (19)  again  follows.  For 
an  arc  on  which  (18)  and  (19)  hold  we  again  have  (20)  so  that  >*  0» 

since  it  has  been  shown  that  p^(t)  > 0 for  t < T,  and  we  have  assumed 
a^b^  > *2^2*  Ic  follow*  Chen  that  there  is  no  singular  solution  (l.e.  no 
singular  subarc  in  the  solution). 

The  analysis  of  constrained  subarcs  also  follows  that  given  above 
for  problem  (2).  We  illustrate  this  for  a constrained  subarc  on  which 
x^(t)  - 0 for  tg  « t < T.  Again,  (36)  and  (37)  hold.  Now 

7u  Tu  (V*‘V)» 

3H  3F 

so  that  — ■ 0 again  yields  (38),  since  — + 0.  It  is  readily  shown 

in  a similar  fashion  that  (40)  and  (41)  still  hold  so  that  the  necessary 

conditions  of  optimality  on  a constrained  subarc  with  x^(t)  - 0 for  a 

finite  interval  of  time  are  again  given  by  (42)  through  (44).  Treatment 

of  other  types  of  constrained  subarcs  is  similar  and  further  discussion 

is  omitted. 

Thus,  we  have  shown  that  the  characterization  of  an  optimal  fire 
distribution  policy  for  the  more  general  redistribution  of  fire  model 
given  above  is  exactly  the  same  as  that  for  problem  (2) . 

10.  Discussion. 


In  this  section  we  discuss  what  we  have  learned  about  the  influence 
of  command  and  control  limitations  on  the  structure  of  optimal  fire 
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distribution  policies.  The  reader  should  bear  In  mind,  moreover,  that 
the  combat  model  considered  In  this  paper  Is  far  too  simple  to  have  the 
results  obtained  from  It  be  taken  literally,  but  he  should  interpret  these 
results  as  Indicating  general  principles  or  hypotheses  to  be  further 
Investigated  by  higher  resolution  analysis  techniques  such  as  field  experi- 
mentation or  computer  simulation.  Nevertheless,  it  is  hoped  that  our  simple 
model  (2)  has  provided  some  insights  into  the  optimization  of  this  combat 
process.  Thus,  it  is  the  form  of  the  optimal  policy  and  its  functional 
dependence  on  model  parameters  that  is  of  primary  interest. 

In  this  paper  we  have  considered  a version  of  the  two-on-one  fire 
distribution  problem  considered  elsewhere  [14],  [18].  In  the  version  (2) 
considered  here  there  are  limits  on  the  rate  at  which  the  distribution  of 
fire  can  change.  This  might  be  thought  of  as  reflecting  a command  and 
control  limitation  (e.g.  the  existence  of  a time  lag  between  the  giving 
of  an  order  and  its  implementation).  From  our  above  study,  we  conclude 
that  the  structure  of  the  optimal  fire  distribution  policy  for  problem  (2) 

(a)  depends  upon  the  model  for  the  attrition  of  X-force  target  types  and 
not  upon  the  nature  of  the  model  for  redistribution  of  fire  (see  Section  9) 
(as  long  as  this  does  not  change  the  functional  form  of  enemy  target-type 
attrition);  (b)  depends  upon  the  following  model  parameters  (see  [16]  for 
further  discussion):  (1)  a^  for  1 ■ 1,2,  (2)  a^  and  a2q,  and  (3) 

whether  Y wins  or  loses;  and  (c)  is  very  similar  to  that  for  the  inertia- 
less  combat  case. 

To  elaborate  further  about  (c) , the  reader  can  find  results  for  the 
insrtlsless  combat  problem  (1)  reported  in  [14],  [18].  When  these  are 
compared  with  those  for  the  problem  at  hand  (2) , there  are  seen  to  be  many 
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similarities  (see  below) . Both  models  have  the  same  attrition  structure 
(for  X-force  target  types),  although  the  model  (2)  considered  here  incor- 
porates command  and  control  limitations.  As  long  as  these  do  not  affect 
the  function  form  of  the  attrition  process  of  enemy  target  types,  the 
optimal  policies  are  similar  (see  also  Section  9). 

We  saw  that  for  both  "Inertialess"  and  "inertial"  combat,  we  must 
necessarily  have 


in  order  for  it  to  be  optimal  to  drive  to  zero  (while  > 0 and 

before  t ■ T) . Furthermore,  we  also  developed  a necessary  condition 
involving  v(t)  * a^(-p^(t))  - a2(-P2^C^  for  it  to  be  optimal  in  (2)  to 
have  $(t)  - 0 for  1 for  a finite  interval  of  time.  Again,  the  results 


were  similar  to  those  for  the  "inertialess"  combat  problem  (1). 

The  sign  of  the  quantity  v(t)  - a^(-p^(t))  - a2(~P2(t))  reflects 
the  ranking  of  target  priorities:  when  v(t)  >0,  is  a higher 

priority  target  for  Y than  is  X2;  and  the  situation  is  reversed  when 
v(t)  <0.  A significant  result  (see  Section  5)  was  that  for  "inertial" 


combat  an  optimal  policy  for  the  distribution  of  Y-fire  over  enemy  target 
types  is  characterized  by  beginning  to  change  the  distribution  of  fire 


(l.e.  shifting  of  fires)  before  target  priorities  (as  measured  by  the  sign 


In  [13]  Schrelber  formulates  a Lanchester-type  combat  model  in  which  the 
effectiveness  of  Intelligence  and  command  and  control  systems  modifies  the 
form  of  combatant  attrition.  These  capabilities  are  Incorporated  into 
Schrelber's  model  through  a parameter  € [0,1]  which  he  denotes  as  "command 
efficiency."  His  equations  reduce  to  Lanchester's  classical  equations  for 
area  fire  when  "command  efficiency"  is  equal  to  zero  for  each  side  and  to 
those  for  aimed  fire  when  it  is  equal  to  one. 

[ *•  I 
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of  v(t))  change.  (It  should  be  recalled  that  in  the  "Inertialess"  version 
of  this  problem  all  fire  was  concentrated  on  the  target  type  with  the 
higher  priority  and  instantaneously  shifted  when  this  changed.)  In  other 
words,  due  to  decreased  reaction  ability  one  begins  to  change  the  distri- 
bution of  fire  before  target  priorities  change  in  anticipation  of  this  coming 
change.  We  might  even  generalize  this  result  to  say  that  with  slow  reactions 
one's  optimal  policy  involves  anticipating  enemy  actions. 

It  should  finally  be  pointed  out  that  to  the  best  of  the  author's 
knowledge  the  problem  (2)  considered  in  this  paper  is  the  first  one  with 

a higher  order  (i.e.  greater  than  first  order)  SVIC  (see  [3],  [6],  [22]) 

* 

to  be  considered  in  the  operations  research  literature.  Moreover,  the 
complete  treatment  of  this  problem  was  made  possible  by  some  recent  results 
of  the  author  [21],  [22]. 


Examples  of  problems  with  an  SVIC  of  order  greater  than  one  have  appeared, 
of  course,  previously  in  the  engineering  literature  (see  [3],  [6]). 
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